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Assay  data  are  often  fit  by  a  nonlinear  regression  model  incorporating 
heterogeneity  of  variance,  as  in  radioimmunoassay,  for  example.  Typically, 
the  standard  deviation  of  the  response  is  taken  to  be  proportional  to  a 

t  •*  *  * 

power  ^  of  the  mean.  There  is  considerable  empirical  evidence  suggesting 
that  for  assays  of  a  reasonable  size,  how  one  estimates  the  parameter  £  does 
not  greatly  affect  how  well  one  estimates  the  mean  regression  function.  An 
additional  component  of  assay  analysis  is  the  estimation  of  auxiliary 
constructs  such  as  the  minimum  detectable  concentration,  for  which  many 
definitions  exist;  we  focus  on  one  such  definition.  The  minimum  detectable 
concentration  depends  both  on  w  and  the  mean  regression  function.  We 
compare  three  standard  methods  of  estimating  the  parameter  6  due  to  Rodbarc 
(1978),  Raab  (1981a)  and  Carroll  and  Ruppert  (1982b).  When  duplicate  counts 
are  taken  at  each  concentration,  the  first  method  is  only  20%  efficient 
asymptotically  in  comparison  to  the  third,  and  the  resulting  estimate  of  the 
minimum  detectable  concentration  is  asymptotically  3.3  times  more  variable 
for  first  than  the  third.  Less  dramatic  results  obtain  for  the  second 
estimator  compared  to  the  third;  this  estimator  is  still  not  efficient, 
however.  Simulation  results  and  an  example  are  supportive  of  the  asymptotic 
theory.  tv* 'J*  •  J 5  Y  '  h  J 
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1-  Introduction 

The  analysis  of  assay  data  has  long  been  an  important  problem  in  clinical 
chemistry  and  the  biological  sciences;  see,  for  example,  Finney  (1964)  and 
Oppenheimer,  et  ai  .  (1983).  The  most  common  method  of  analysis  is  to  fit  a 
nonlinear  regression  model  to  the  data.  Much  recent  work  suggests  that  these 
data  can  be  markedly  neteroscedastic ;  in  radioimmunoassay,  for  example,  this 
characteristic  has  been  observed  repeatedly  and  incorporated  into  the  analysis 
as  discussed  by  Finney  (1976).  Rodbard  (1978),  Tiede  and  Pagano  (1979)  and 
Raab  ( 1981a,  b)  and  Butt  (1984).  Such  analyses  are  for  the  most  part  special 
cases  of  the  heteroscedastic  nonlinear  regression  model.  Specifically,  we 

observe  independent  counts  Y„  at  concentrations  x^  for  i  =  1 . N  and  j  = 

l....M^  with  mean  and  variances  given  by 


d.l)  E  Y±  j  =  Hi  =  f(x.,P)  :  varfY.j)  =  {og(x.  ,p.e )  }2, 

where  p>  is  the  unknown  regression  parameter  vector  of  length  p  and  6  is  the 
structural  variance  parameter.  A  fairly  standard  model  for  the  mean  in  a 
radioimmunoassay  is  the  four  parameter  logistic  model 

U.2)  f(x,/J)  =  fl1  +  (fi2  -  /JJ/fl  -  exp{/J4  ( log  x  -  P3)>] 

Almost  without  exception,  the  variances  have  been  modeled  as  functions  of  the 
mean  response,  usually  either  as  a  quadratic  or  as  a  power  of  the  mean,  eg.. 
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incorporate 

the  heterogeneity 

into 

the  analysis; 

the  result 

of 

the  i  r 

contribution 

has  been  a  great 

improvement  in  the 

quality  of 

stat 

istical 

analysis . 

Methods 

of  estimating  p  and 

0  are 

discussed  in  Section  2.  The 

most 

common 

method  of  estimating  p  is  generalized  least  squares.  By  various  devices,  one 
forms  estimates  o.  of  the  variances  and  then  estimates  p  by  weighted  least 
squares.  As  discussed  by  Jobson  and  Fuller  (1980)  and  Carroll  and  Ruppert 
(1982b),  under  quite  general  circumstances  for  large  enough  sample  sizes  how 

one  estimates  the  variance  does  not  matter,  and  p  is  asymptotically  normally 

2  - 1 

distributed  with  mean  p  and  variance  (o  /N  )S„  ,  where  N’  is  the  total  sample 

b  u  S 

size  and 


(1.4) 


c  _  -1  _N  _M. 

SG  ‘  NS  Zi=lij-1 


{f^(x..yQ)f/S(x.,/3)T).g2(x.  ,/3.e 


and  fp  the  derivative  of  f  with  respect  to  p.  It  has  been  shown  that  for 
estimation  of  p .  how  one  estimates  the  variance  function,  in  particular  the 
parameter  e.  has  only  a  second  order  effect  asymptotically,  see.  for  example, 
Rothenberg  (1984).  The  general  asymptotic  result  (1.4)  can  be  optimistic,  but 
in  our  experience  for  RIA  and  ELISA  assays,  the  asymptotics  are  often  rather 
reasonable . 

What  the  previous  discussion  suggests  is  that  if  our  only  interest  is  to 
estimate  P ,  then  in  many  assays  the  method  of  estimating  the  variance  function 


may  not  be  crucial.  However,  the  assay  problem  does  not  always  stop  with 
estimating  p ,  but  rather  also  addresses  issues  of  calibration.  These  issues 
include  confidence  intervals  for  a  true  x*  given  a  new  Y* ,  the  classic 
calibration  problem.  Also  of  interest  is  determining  the  sensitivity  of  the 
assay  using  such  concepts  as  the  minimum  detectable  concentration  of  Rodbard 
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(1978)  and  the  critical  level,  detection  level  and  determination  limit  of 


Oppenheimer,  et  al  .  (1983).  A  unique  feature  of  these  calibration  problems  is 


that  the  efficiency  of  estimation  is  essentially  determined  by  how  well  one 


estimates  the  variance  parameter  9;  the  purpose  of  this  paper  is  to  justify 


this  claim. 


To  the  best  of  our  knowledge,  our  paper  is  one  of  the  first  which  shows 


explicitly  that  how  one  estimates  the  structural  variance  parameter  9  can  be 


important  in  determining  the  behavior  of  estimates  of  interesting  quantities. 


Far  from  being  only  a  nuisance  parameter  as  it  is  often  thought  to  be,  9  is 


quantity  which  has  an  important  role  in  the  analysis  of  calibration  and 


prediction  problems.  In  addition,  9  can  be  important  in  itself,  as  in  for 


example  off  line  quality  control,  see  Box  and  Meyer  (1986).  In  this  latter 


application,  one  might  want  to  find  the  levels  of  x  which  give  minimum  variance 


subject  to  a  constraint  on  the  mean. 


Our  general  qualitative  conclusion  is  that  how  well  one  estimates  9  really 


matters.  Instead  of  pursuing  a  fully  general  theory,  we  focus  on  the 


determination  of  minimum  detectable  concentration.  There  is  no  unique 


definition  of  this  concept,  and  for  illustration  we  pick  one  of  the  possible 


candidates . 


Def in j  tion .  Let  Y(x,M)  be  the  mean  response  based  on  M  replicates  at 


concentration  level  x.  taken  independently  of  the  calibration  data  set  (Y..). 


Let  f(0./J)  be  the  expected  response  at  zero  concentration  based  on  the 


calibration  data  set.  The  minimum  detectable  concentration  x  at  level  (  l  -a ) 

c 


is  the  smallest  concentration  x  for  which 


Pr{Y(x  ,.M)  >  f  (  0  ,/J ) }  >  1  -  a. 
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Qualitatively,  the  minimum  detectable  concentration  is  arrived  at  as 
illustrated  in  Figure  1.  One  first  constructs  the  estimated  regression 
function  f(x,/3),  and  then  attaches  to  it  an  estimated  lower  (1-a)  confidence 
line  for  the  new  response  Y(x,M)  at  concentration  x  based  on  M  replicates. 
Starting  from  the  estimated  zero  concentration  mean  f{0,/3),  one  does  a  standard 
calibration  by  drawing  a  horizontal  line  until  it  intersects  the  lower 
confidence  interval,  the  value  of  x  at  which  this  intersection  occurs  being  the 
minimum  detectable  concentration.  In  Figure  1,  we  illustrate  why  getting  a 
good  handle  on  the  variance  function  is  important.  Assuming  as  is  natural  that 
the  variance  is  smallest  where  the  mean  count  is  smallest,  we  see  that  the 
prediction  interval  based  on  an  unweighted  analysis  is  much  too  conservative 
for  low  concentrations.  This  translates  immediately  into  a  large  bias  in  the 
estimated  minimum  detectable  concentration.  Even  if  the  heterogeneity  of 
variance  is  taken  into  account,  Figure  1  makes  clear  that  a  poor  estimate  of  6 
can  have  considerable  impact  on  the  estimated  minimum  detectable  concentration. 

We  now  outline  the  standard  method  for  estimating  the  minimum  detectable 

concentration.  To  be  more  precise  and  follow  the  outline  given  in  the 

preceeding  paragraph,  one  would  replace  the  t-percentage  point  to  follow  with 

an  asymptotically  negligible  correction  based  on  the  limit  distribution  of  the 

estimates  of  (6,/3.o).  This  program  has  not  been  followed  in  practice  since  the 

last  limit  distribution  has  been  unknown,  and  in  any  case  the  effect  is 

asymptotically  unimportant.  If  t(a,Ns~p)  is  the  (l-ct)^h  percentile  of  the 

t - d i s t r ibu t ion  with  X  -p  degrees  of  freedom,  the  usual  estimate  x  of  x 

s  c  c 

sat isf ies 


16)  (f(xr./3)  -  f(0,/!!)2  =  {t(a,Xs-p)}2{o2g2(xc,/J.e)/M  -  var  [  f  (  0  ,/3 )  ] )  . 


'TOT' 


■■wwTWTnrw 


w 
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“  ~  *  ~2 
where  var[f(0,/J)]  is  an  estimate  of  the  variance  of  f(0,/3)  and  a  is  the  usual 

mean  squared  error  from  the  weighted  fit: 

"2  -i  v  M  2  -?0 

c  =  (X  -p)  V  {Y  -  f  (x,  ./J)5  f  "  (x.,/5). 

o  j.  a 

in  Section  2  of  this  paper,  we  discuss  three  standard  methods  for- 
estimating  the  variance  parameter  0.  L’nder  relatively  general  conditions,  two 
of  these  can  be  quite  a  bit  less  efficient  than  the  third,  and  we  discuss  in 
Section  3  how  this  difference  translates  theoretically  to  the  minimum 
detectable  concentration  problem.  In  Sections  4  and  5,  we  present  a  small 
Monte-Carlo  study  and  an  example  to  illustrate  the  results.  The  key  conclusion 
is  that  how  one  estimates  6  can  affect  the  relative  efficiency  of  estimated 
quantities  useful  in  the  calibration  of  assays. 


2.  Methods  of  estimating  mean  and  variance  parameters 

The  problem  of  estimating  9  in  models  (1.1)  and  (1.3)  has  been  discussed 
in  many  places  in  the  literature.  A  nice  introduction  is  given  by  Judge,  el 
ai.  (1935,  Chapter  11).  More  specialized  and  formal  treatments  include  those 
by  Rodbard  (1978),  Jobson  and  Fuller  (1980),  Raab  (1981a),  Carroll  and  Ruppert 
(1982b)  and  Davidian  and  Carroll  (1986),  although  these  only  represent  a 
sampling  of  the  possible  selection.  We  focus  our  attention  on  three  methods 
with  quite  different  motivations.  For  simplicity,  we  will  discuss  only  the 
case  of  equal  replication  M  =  M  >  2.  The  first  two  methods  require  some 
replication . 
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2 . 1  Log- 1  inear ized  estimation 

Model  (1.3)  implies  upon  taking  logarithms  that  the  lug  standard  deviation 

_  2 

is  linear  in  the  log  mean  with  slope  0.  Letting  (YL  ,S^  )  be  the  within 
concentration  sample  means  and  variances,  this  suggests  that  one  estimate  0  as 
the  slope  from  regressing  log  on  log  Y^  .  If  we  denote  this  estimate  as 
0rr,  Rodbard  (1978)  suggests  forming  estimated  standard  deviations  as  the 

L.L 

A 

sample  mean  to  the  power  9^^, and  then  applying  weighted  least  squares  to 
estimate  p . 

2.2  Madjj.i  qgl ,  m  4-1  j  ro.yji ..  .jj  k  e  1 1  ,h  o  Q  d 

Raab  (1981a)  suggests  a  method  for  estimating  0  using  normal  theory 
maximum  likelihood  but  without  making  any  assumptions  about  the  form  of  the 
mean  function.  Raab  assumes  independence  and  proposes  estimation  of  0  by  joint 
maximization  of  the  "modified"  normal  likelihood 

(2.1)  Zr'!’  {2tro2g(f/ .  ,0  ) }  * m  *  ^  2exp[ -rm_ .  ( Y .  . -/j  .  )  “  (  2o‘"g  ip  .  .0  )  )  ] 

i  - 1  l  J  =  i  l  j  i 


in  the  parameters  a,  d,  jj  , 

••  A- 

where  we  have  written  g 

(>:  .3.0)  as  g  ifj 

,9  ) 

; 

to  emphasize 

the  dependence 

of  the 

variance  function  on  the 

mean  response 

The 

modif ication 

serves  to  make 

2 

the  estimator  of  a  unbiased 

Es  t i ma t i on  of  p 

may 

now  proceed 

via  weighted 

least 

squares  in  a  fashion 

analogous  to 

the 

log-linearized  method. 


2 . 3  Pseudo-i ikel ihood 

For  given  9,  the  pseudo- 1 ikel ihood  estimator  of  9  is  the  normal  theory 
maximum  likelihood  estimate,  maximizing 

12.2) 

i  1  J  —  J.  1 

-  (\t'2)log[rtj  =  1ZJ?=1{Yij-f(x.  ,/J)}2g(x.  ./3,ef 2]  , 

see  Carroll  and  Ruppert  (1982b).  One  can  devise  many  ways  to  estimate  9  and  p 
jointly.  For  example,  one  can 

(i)  Set  p  =  unweighted  least  squares; 

(ii)  Estimate  S  by  pseudo- 1  ikel ihood ; 

o  *  * 

(in)  Form  estimated  variances  g”(x^./5,9): 

( iv)  Re-estimate  p  by  weighted  least  squares; 

(v)  Iterate  (ii)  -  (iv)  one  or  more  times. 

The  number  of  cycles  t  of  this  algorithm  is  the  number  of  times  one  hits  step 
(iv).  One  can  do  step  (ii)  by  direct  maximization  or  by  weighted  least  squares 
as  in  Davidian  and  Carroll  (1986). 

A  key  point  to  note  is  that  pseudo- I ikel ihood  requires  no  replication  and 
hence  easily  copes  with  unequal  replication. 

2 . 4  Other  methods 

Various  other  methods  have  been  proposed;  see,  for  example.  Jobson  and 


Fuller  (1980)  and  3ox  and  Hi 


(  1974)  . 


Robust,  variance  function  estimation 


methods  have  also  been  developed,  see  Carroll  and  Ruppert  (1982b)  and  Giltinan. 
Carroll  and  Ruppert  (1986). 

A  final  method  of  jointly  estimating  (/3,0)  is  normal  theory  maximum 
likelihood.  There  are  important  issues  of  robustness  which  complicate  routine 
use  of  this  method,  see  McCullagh  (1983),  Carroll  and  Ruppert  (1982a)  and 
Davidian  and  Carroll  (1986)  for  further  discussion.  For  assay  data, 
pseudo- 1 ikel ihood  and  maximum  likelihood  estimates  of  0  have  similar  asymptotic 
behavior,  and  we  will  use  the  former  largely  for  its  ease  of  calculation. 


i _ Asymptotic  theory 

The  asymptotic  theory  of  the  log-linearized  estimator  9  is  complicated 

LiIj 

because  regressing  log  S.  on  log  7.  is  not  a  standard  linear  regression 
problem.  Likewise,  the  asymptotic  theory  for  the  modified  maximum  likelihood 
estimator  8  is  complicated  because  the  dimension  of  the  parameter  space 
increases  with  X.  Both  of  these  problems  are  nonlinear  functional 

errors-in-var iables  problems  of  kind  addressed  by  Wolter  and  Fuller  (1982). 
Amemiya  and  Fuller  (1985)  and  Stefanski  and  Carroll  (1985).  The  error  in 
estimating  ^ .  by  Y.  in  0  or  by  the  joint  estimator  /j  .  in  0  causes  these 
estimators  to  be  biased  asymptotically.  This  bias  is  typically  negligible, 
because  in  most  of  the  assays  we  have  seen  the  parameter  o  in  (1.1)  is  quite 
small.  Thus,  empirically  it  makes  sense  to  define  an  asymptotic  theory  where 
the  sample  size  X  =  N'M  becomes  large  and  o  simultaneously  is  small.  Because 
in  most  assays  the  number  of  replicates  M  is  small,  we  shall  let  X  -*  <»  and  a  -• 
0  while  keeping  M  fixed;  Raab  (1981a)  suggests  that  M  =  2  is  the  most  common 


9 


It  is  important  for  the  reader  to  understand  that  letting  X  -*  »  and  a  0 

simultaneously  is  dictated  by  the  problems  of  studying  the  log- 1 inearized 

estimator  0,T  and  the  modified  maximum  likelihood  estimator  0„„, :  the 
LL  MML 

pseudo-likelihood  estimator  0  has  a  routine  asymptotic  theory  even  for  fixed 


The  asymptotic  distribution  of  these  estimates  of  9  can  be  obtained  from 
the  general  theory  of  Davidian  and  Carroll  (1986).  Define 


e.  ;  =  (Y.  -  f(x.  ,/5)}/{of  (x.  ,/J) 


V.  =  log  f (X. ,/3) 


q2  =  <(M-lflZ*  _  (4  -  )2! 

1  1  -  1  1  J  X 


°l  ■  -  v)2 


Theorem  1.  As  X  -*  ■»  and  a  -*  o  simultaneously  and  X  a  =  C  ( 1 )  ,  if  the  random 
variables  (t^J  are  symmetric  and  independent  and  identically  distributed,  then 


N1  2(®ll  ~  e)  N’(°-  var  { log  q.}/(4o2)), 


N'"  2(eMMT  *  6  )  *  X(0 .  var(q2  )/(4o2)  )  . 
MML,  1  V 


N1 ,2(epi  -  9)  i  N( 0 ,  var(£2j)/(4>to2)  ) 


Under  these  asymptotics,  the  symmetry  condition  is  necessary  to  ensure  that  the 

asymptotic  distributions  of  0  and  8  have  zero  mean;  symmetry  is 

L  L  MM  L 


unnecessary  for  the  result  for  0. 


Sadler  and  Smith  (1985)  note  that  the 


estimator  obtained  by  replacing  £(.  by  Y.  in  (2.1)  and  maximizing  in  o  and  0 
is  virtually  indistinguishable  in  practice  from  the  full  modified  maximum 


m 

§£ 


m 


I' 


i 


S3 


& 


likelihood  estimator  of  9  .  It  can  be  shown  that  these  two  estimators  are 

asymptotically  equivalent  under  the  above  asymptotics  and  that  this  second 

estimator  is  equivalent  to  the  pseudo-likelihood  estimator  with  f(x.,/J) 

replaced  everywhere  by  Y.  in  (2.2);  thus,  as  an  approximation  to  9  one 

1  •  MML 

could  compute  the  pseudo- 1 ikel ihood  estimator  using  Y  . 

From  Theorem  1,  the  asymptotic  relative  efficiencies  of  the  log- 1  inear i zed 
method  and  the  modified  maximum  likelihood  method  relative  to  pseudo- 1 ikel ihood 
can  be  computed.  Note  that 


(3.1) 


var(q.)  =  var(£^.j)/M  +  2/ { M  ( M- 1 )  > 


so  that  9  has  uniformly  larger  asymptotic  variance  than  9  for  all  M  >  2 
MML  r  L 

regardless  of  the  distribution  of  the  {£_}. 

We  have  tabulated  the  relative  efficiencies  of  9  T  and  to  0_r  for 

LL  MML  rL 

various  numbers  of  replications  M,  assuming  normally  distributed  data. 


Asymptotic  relative  efficiencies  of  estimators  of  9  for  small  a 


M 

4ll-S2-4pl 

9mll  t0  9pl 

9ll  t0  ®MLL 

2 

0.203 

0.500 

0.405 

3 

0.405 

0.667 

0.608 

4 

0.535 

0.750 

0.713 

| 

9 

0.783 

0.889 

0.881 

10 

0.804 

0.900 

0.893 

mmn 


In  our  experience,  these  numbers  slightly  exaggerate  the  inefficiency  of  6^; 
relative  to  pseudo- 1 ike  1 ihood ,  especially  when  the  assay  is  rather  small.  For 
duplicates  M  =  2.  in  two  assay  simulations,  we  have  found  that  the  variance 
efficiency  of  the  log-linearized  method  was  0.35  and  0.31;  the  former  number  is 
reported  in  the  next  section.  The  asymptotic  relative  efficiencies  of  0 

L  L 

relative  to  0„_,r  agree  quite  well  with  the  efficiencies  of  39%,  62%  and  77%  and 
MML 

39%.  64%  and  74%  for  M  =  2,  3  and  4  reported  by  Raab  (1981a)  and  Sadler  and 

Smith  (1985).  respectively,  in  two  Monte-Carlo  studies.  While  modified  maximum 
likelihood  represents  an  improvement  over  the  log-linearized  method,  the  theory 
clearly  points  to  the  inefficiency  of  both  the  log-linearized  and  modified 
maximum  likelihood  methods  when  the  number  of  replicates  is  small  and  the  data 
are  nearly  normally  distributed. 

For  the  minimum  detectable  concentration,  note  that  in  (1.6)  the  term 

var{f(0./3)}  is  of  the  order  (N’M)  1  and  is  hence  rather  small  relative  to  all 

the  other  terms.  Of  course,  for  normally  distributed  data,  the  solution  to 

* 

(1.6)  is  the  quantity  x  .  where 

2  2  20  *  *  2 
(3.2)  0  =  (z(a) )  cTf  (xc>p)/M  -  { f  ( x£ ./» )  -  f  (0 ,p)>  . 

ans  z(a)  is  the  (1  -  a)fc^  percentile  point  of  the  standard  normal  distribution. 

Here  is  the  major  result,  the  technical  details  for  which  are  given  in  the 
appendix.  Define 

dQ  =  log  f(0,/3)  -  lim^^  N'  log  f(x.,p). 

Let  x  (LL),  x  (MML)  and  x  (PL)  denote  the  estimated  minimum 

c  c  c 

concentrations  using  the  log- 1  inear i zed  estimate  0  ,  the  modified 


,  <\  r.y. 
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max:  .num  likelihood  estimate  ®  vjvfl  anc*  the  Pseudo -1  ike]  ihood  estimate  9pr 
respectively.  Then  under  regularity  conditions,  there  is  a  constant  AQ  and  a 
sequence  b,.  for  which 


(3.4)  b  .  A„  N’1,2(x  (LL)  -  x  ) 'o  ^  N  ( 0 ,  var(£2.)  -  var(log  q^Jd^M/o2 
NO  C  C  lj  lOv 


(3.5)  b  A.  N1/2(x  ( MML )  -  x  )  ,'a  *  N’(0,  var(£2.)  *  var(q2 )d2M  o2  ) 
NO  c  c  lj  l  0  v 


b  A  N1/2(x  (PL)  -  x*)/0  i  N( 0 ,  var (fe2  . ) { 1  -  d2/o2}  ).  □ 

\0  c  c  l  j  0  v 


From  (3.1),  the  asymptotic  relative  efficiency  of  the  modified  maximum 
likelihood  estimate  to  minimum  detectable  concentration  relative  to  the 
pseudo-likelihood  estimate  is 


(3.7) 


var(fe2.)(o2-d  )/{var(fe2.)(o2+d  )  *  2d2/(M-l)} 
l  j  v  0  i  j  v  0  0 


which  is  less  than  1  for  all  M  regardless  of  the  value  of  var(£„).  Similarly, 
the  asymptotic  relative  efficiency  of  the  log-linearized  estimate  of  minimum 
detectable  concentration  to  the  pseudo-likelihood  estimate  is 


(3.8) 


var(42j ) (o2-d2)/{o2var(t2j )  -  Md2var(log  q2)} 


It  follows  from  Theorem  1  and  (3.7)  and  (3.8)  that  the  ordering  in  efficiency 
of  estimated  minimum  detectable  concentration  is  the  same  as  the  ordering  for 
estimating  9  and  thus  will  favor  pseudo- 1 ikel ihood  for  normally  distributed 
data  in  the  case  of  the  log-linearized  estimator  and  for  all  distributions  in 
the  case  of  the  modified  maximum  likelihood  method.  For  distributions  other 


13 


than  normal,  calculations  with  other  symmetric  distributions  such  as  double 


exponential  and  various  contaminated  normal  distributions  show  very  few  cases 

where  9rr  is  more  efficient  than  9  .  see  Davidian  (  1986).  The  numerical 

LL  r  l. 

2  2 

efficiencies  depend  on  the  logarithm  of  the  true  means  through  d  and  a  .  For 


example,  in  the  simulation  discussed  in  the  next  section,  the  asymptotic 
relative  efficiency  of  the  log-linearized  estimate  is  27%  for  M  =  2  and  63%  for 
M  =  4. 


The  asymptotic  theory  thus  suggests  that  inefficiencies  in  estimating  the 
variance  parameter  e  translate  into  inefficiencies  for  estimating  the  minimum 
detectable  concentration. 


To  check  the  qualitative  nature  of  the  asymptotic  theory,  we  ran  a  small 
simulation.  We  restrict  our  focus  here  to  the  log-linearized  method  and 
pseudo-1 ikel ihood . 

The  responses  Y„  were  normally  distributed  with  mean  and  variance 

satisfying  (1.2),  (1.3),  where  p  =  29.5274,  p  =  1.8864,  p  =  1.5793,  p  = 

1  d  o  4 

1.0022,  9  =  0.7  and  o  =.0872.  The  23  concentrations  chosen  are  given  in  Table 
4.  We  studied  the  case  M  =  2  or  duplicates  and  M  =  4  or  quadruplicates.  For 
each  situation,  there  were  500  simulated  data  sets.  A  limited  second 
simulation  was  run  with  the  larger  value  a  =  0.17,  but  there  did  not  appear  to 
be  significant  qualitative  differences  from  the  case  reported  here. 

The  estimators  chosen  were  unweighted  least  squares  for  p  .  the  Rodbard 
log- 1  inear ized  method  and  the  pseudo-1  ikel ihood/general i zed  least  squares 
combination  which  we  report  only  for  t  =  1  and  2  cycles  of  the  algorithm.  The 
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methods  of 

Sect  ion  1  . 

iJCfl 

1.50. 

In  Table  1  .  we  compare  the 


detectable  concentration  are  as  discussed  in 
constrained  to  lie  in  the  interval  0  <  0  < 

estimators  of  0  on  the  basis  of  bias  and 


variance.  The  biases  are  large  relative  to  the  standard  error,  so  that 
mean-squared  error  comparisons  are  artificial  and  dramatic.  The  bias  in  the 
pseudo- 1  ike l ihood  estimate  of  B  when  doing  only  f  =  1  cycles  of  the  algorithm 


has  been  observed  by  us  in  other  problems.  One  sees  here  that  the  effect  of 
doubling  the  replicates  from  two  to  four  for  a  given  set  of  concentrations 
improves  the  Monte-Carlo  efficiency  of  the  log-linearized  estimate  of  0  from 
35%  to  58%,  compared  to  the  theoretical  asymptotic  increase  from  20%  to  54%. 
This  example  indicates  that  pseudo- 1 ikel ihood  estimation  of  0  can  in  some 
circumstances  be  a  considerable  improvement  over  the  log-linearized  method. 

For  the  minimum  detectable  concentration  we  chose  a  =  0.05.  For  all  of 
the  methods  used  in  the  study,  the  probability  requirement  (1.5)  was  easily 
satisfied;  rather  than  95%  exceedance  probability,  every  case  was  more  than 
97%.  The  mean  values  of  the  minimum  detectable  concentrations  are  reported  in 
Table  2.  with  variances  given  in  Table  3.  Note  that  in  both  of  these  tables, 
we  give  results  for  the  case  that  9  is  known  as  well  as  estimated.  The 


relatively  poor  behavior  of  unweighted  least  squares  is  evident.  To  quote  from 


Oppenheimer,  et  al .  (1983):  "Rather  dramatic  differences  have  been  observed 


depending  on  whether  a  valid  weighted  or  inappropriate  unweighted  analysis  is 


used."  When  the  variance  parameter  0  is  known,  there  is  little  difference 


between  any  of  the  weighted  methods. 


When  0  is  unknown,  there  are  rather  large  proportional  differences.  The 


figures  in  Table  4  show  that  the  mean  minimum  detectable  concentration  for  the 


log- 1 inearized  method  is  10%  larger  than  for  the  pseudo- 1 ikel ihood  method  based 
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on  t  =  2  cycles;  whether  the  raw  numerical  difference  is  of  any  practical 

consequence  will  depend  on  the  context. 

For  M  =  2  replicates,  the  pseudo-likelihood  estimate  of  minimum  detectable 

-2 

conentration  with  unknown  0  has  mean  3.934  x  10  and  standard  deviation  0.05  x 

-4  -2  -4 

10  ;  the  corresponding  figures  for  M  =  4  are  2.722  x  10  and  0.028  x  10 

Proportionately ,  when  0  is  unknown,  the  method  of  estimating  it  seems  to  have 

important  consequences  for  the  estimate  of  minimum  detectable  concentration . 

particularly  in  the  variability  of  the  estimate.  For  the  case  of  duplicates, 

the  Monte-Carlo  variance  of  pseudo- 1  ike  1  ihood  is  only  37%  as  large  as  that 

based  on  the  log-linearized  estimate,  while  the  asymptotics  suggest  27%, 

increasing  to  71%  and  63%  respectively  for  quadruplicates. 

The  point  here  is  that  the  relative  efficiency  of  the  estimated  minimum 

detectable  concentration  can  be  affected  by  the  algorithm  used  to  estimate  the 

variance  parameter  0. 


5.  An  example 

Differences  among  the  three  estimators  of  9  and  the  subsequent  estimators 
of  minimum  detectable  concentration  which  are  reminiscent  of  the  qualitative 
implications  of  the  asymptotic  theory  and  simulation  can  be  seen  in  the 
following  example.  The  data  are  from  a  radioimmunoassay  and  are  presented  in 
Table  4.  The  analysis  presented  here  is  for  illustrative  purposes  only;  we  do 
not  claim  to  be  analyzing  these  data  fully.  Our  aim  is  to  exhibit  the  fact 
that  the  three  methods  of  analysis  considered  in  this  paper  can  lead  to 
nontrivially  different  results. 

We  assumed  in  all  cases  the  model  (1.2)  and  (1.3).  For  the  full  data  set 
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and  reducod  data  sets  considering  ail  possible  permutations  of  duplicates 

2 

(except  one  set  for  which  an  S.  *  0.  complicating  the  application  of  the 

p 

iog-  i  inear ized  method),  we  computed  the  estimates  of  8,  o  and  x  using  the 
pseudo-likelihood  and  log- 1 inearized  methods  and  the  estimate  of  Sadler  and 
Smith  (1985)  as  described  in  Section  3  in  place  of  the  more  computationally 
difficult  modified  maximum  likelihood  estimate.  We  also  computed  the  estimate 
of  minimum  delectable  concentration  based  on  ordinary  least  squares.  The 
results  are  given  in  Table  5. 

An  investigation  of  both  the  full  and  reduced  data  sets  suggests  that 
there  are  no  massive  outliers  and  that  design  points  1.  22  and  23  are  possible 
high  leverage  points.  For  our  purposes  of  illustration  we  do  not  pursue  this 
point;  see  Davidian  and  Carroll  (1986)  for  discussion  on  accounting  for 
leverage  in  estimation  of  9. 

The  results  of  Table  5  show  that  the  three  estimates  can  vary  greatly.  As 
a  crude  measure  of  this,  consider  the  means  and  standard  deviations  of  9  and  x 

c 

for  the  five  data  sets  obtained  by  considering  duplicates  (ignoring  the  fact 
that  these  data  sets  are  not  strictly  independent).  Below  we  list  "relative 
efficiencies"  for  the  estimators  based  on  these  crude  measures: 


Relative  efficiencies"  for  estimators  of  e  and  x^ 
for  data  in  example  when  M  =2 


9 

X 

c 


LL  to  PL 
.  222 
.529 


MML  to  PL 
.  351 
.659 


LL  to  MML 
.632 
.802 


Qualitatively,  the  estimates  exhibit  the  type  of  behavior  predicted  by  the 
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asymptotic  theory;  quantitatively,  the  values  compare  favorably  with  what  the 
theory  would  predict  given  the  crudity  of  the  comparison. 

This  example  shows  that  there  can  be  wide  differences  among  the  various 
estimation  methods  for  9  and  minimum  detectable  concentration  in  application 
and  that  the  qualitative  way  in  which  the  differences  manifest  themselves  is 
predicted  by  the  asymptotic  theory  of  Section  3. 

(L _ Incorporating  unknowns  and  standards 


In  many  assays,  along  with  the  known  standards  {Y..,x.}  there  is  an 

*  * 

additional  set  {Y.  .}  of  proportional  size  at  unknown  concentrations  { x .  > ,  i  = 
i  J  i 

* 

1 . X  ,  j  =  1 . M..  It  is  common  to  assume  that  these  unknowns  satisfy 


(6.1) 


*  *9 

Standard  Deviations  (Y.  .)  =  o*(E  Y.  .) 

ij  *  1J 


The  power  of  the  log-linearized  or  modified  likelihood  methods  is  that  they  can 

incorporate  the  responses  at  unknown  concentrations  to  obtain  a  better  estimate 

of  9.  pseudo- 1 ikel ihood  and  other  similar  techniques  cannot  easily  incorporate 

* 

this  information  because  they  rely  on  knowing  the  concentrations  {x.}.  A 
simple  way  to  improve  pseudo- 1  ike  1 ihood  to  take  into  account  the  unknowns  is  to 
incorporate  the  additional  information  about  the  variances  in  the  unknowns  by 
exploiting  an  estimator  that  does  not  depend  on  the  form  of  the  mean  response. 
For  the  exposition  here,  consider  the  log  linearized  estimator;  wp  could 
equally  well  employ  the  same  idea  using  the  modified  maximum  likelihood 

estimator.  Let  9  and  9  denote  the  log-linearized  estimates  of  9  based  on 

u  s ,  u 

the  unknowns  alone  or  the  full  data  respectively,  and  let  0p^  denote  the 
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ft 


pseudo- 1 ikel ihood  estimate  based  on  the  standards  alone.  Let  S  denote  the 

u 

variance  estimate  of  produced  by  the  linear  least  squares  program  and  let 
2 

Sp^  be  the  estimated  variance  of  0pr>  where  following  Theorem  1 


.  sample  variance  of 

,  'standardized  squared  residuals  r.  . 
-1  _ _ _ ij 

.sample  variance  of  log  predicted  . 


values  log  f  ( x.  ,/3 ) 


r.  .=  {Y.  .  -  f  ( x .  ,/3)}/ {o f  ( x  .  ,p) 
ij  i j  l  ^  l  r 


Then  a  weighted  estimate  of  6  is  simply 


8  ■  "V  -  "-“’V  "  ■  Su'-'Su  -  SPL> 


we  prefer  to  replace  6^  by  ^  in  (6.2).  The  weighted  estimate  (6.2)  will 
improve  upon  the  log-linearized  estimate  9g  u  based  on  all  the  data,  although 
the  degree  of  improvement  will  be  smaller  than  that  found  in  Sections  3  or  4. 
For  example,  if  there  are  exactly  as  many  unknowns  as  standards  and  duplicates 
are  used,  then  Sg  has  asymptotic  relative  efficiency  of  34%  versus  20%  when 
only  standards  are  available. 


iscussion 


We  have  addressed  the  general  issue  of  estimating  calibration  quantities 
in  assays  which  exhibit  large  amounts  of  heterogeneity.  We  have  shown  that  not 
weighting  at  all  leads  to  large  decreases  in  the  efficiency  of  analysis.  Even 


1' 


when  weighting  is  used,  we  have  shown  that  changes  in  relative  efficiency  occur 
depending  on  the  method  of  estimating  the  variances,  especially  the  parameter  $ 
in  (1.3).  The  key  point  is  that  while  for  estimation  of  p  the  effect  of  how 
one  estimates  the  variance  function  is  only  second  order,  for  estimation  of 
other  quantities  such  as  minimum  detectable  concentration,  the  effect  is  firs' 
order . 

We  have  had  success  using  the  idea  of  pseudo- 1  ikel  ihood  in  Carroll  anti 
Ruppert  (1982b);  this  method  applies  in  general  heteroscedastic  models  and  is 
easy  to  compute  as  shown  in  the  appendix,  although  the  reader  should  be  aware 
chat  it  is  not  robust  against  outliers. 

One  can  also  consider  data  transformation  rather  than  weighting.  The 
transform-both-s ides  idea  in  Carroll  and  Ruppert  (1984)  applies  to  the  assay 
problem . 
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Appendix 


The  analysis  of  the  minimum  detectable  concentration  is  complicated  by  the 

behavior  of  the  derivative  of  f(x,/3)  with  respect  to  p>  at  x  =  0,  especially  for 

* 

the  standard  model  (1.2).  We  will  write  f(x,/3)  =  h(q  ,ft) .  where  q  =  £(x,/3),  q 
*  -  - 

-  f.(x  ,p)  and  q ^  =  ffx^./O).  In  the  model  (1.2),  q  =  f(x,/3)  =  exp(/3^  log  x). 
We  assume  throughout  that  f(0,/3)  >  0,  and  that  all  functions  are  sufficiently 


(  A  .  4  ) 


If  w  -»  0  and  v  is  a  random  variable  such  that 


sup{ 


P 

f  (v./J)/f  (w.yS)  - ►  1  . 

e  (av-(i<t)w./s)  -'e  (w,fl)  -  i 


then 

for  0<a<  1 


P 


0 


These  assumptions  are  satisfied  for  the  model  (1.2)  if  p  >  0. 

4 

We  need  the  following  results.  The  proofs  of  Lemmas  A. 2  and  A. 3  will  be 

2 

at  the  end  of  the  appendix.  Let  c  =  (z{a)} 


Lemma  A .  1  As  a  -*  0  for  f(0,/3)  >  0. 


q *  =  oac  -C(o2),  ac  =  (c/M)  1/2fS  (0,/3)  {d/dq  h(O.p)}'1 


Proof :  A  Taylor  series  expansion  of  (3.2)  in  q^  and  around  zero.  □ 


*  1/2 

Lemma  A.  2  Assume  that  as  X  -*  «o.  o  ->  0 .  (n  -  n  )  =  C  loV  1.  Define 

'c  c  p 


2  p  B 

Aj  =  2Mac  {d/dq  h(0.p))  /{cf  ( 0  ,/J ) } . 


1/2  ' 

Then  as  X  -»  »,  c  ■»  0,  if  N  (9  -  9  )  =  C^(l),  we  have  the  asymptotic  expansion 


(A. 5) 


1/2*  * 

V  (,7c  ~v/o 


N1/2(o2  -  o2)/o2  -  2  { 1  og  f(O.P)}  N 12  (9  -0)<-o  (1).  □ 

P 


Lemma  A. 3  Consider  Lemma  A. 2.  Then 


,1 


1  =  1  j  =  r  u 


1  '2 

so  that  if  Aq  =  M 


v:  2wc  ■  V'° 


1)  -  2dQ(NM)  (9-6)  -  op(l) 


where  dQ  is  defined  in  (3.3).  0 


1/2  *  * 

Proposition  1  The  limit  results  (3.4)  -  (3.6)  hold  for  AQ  X  (q  -q  ) !a 

where  q^  =  q  LL).  ^(MML)  or  ^(PL). 


:  From  Davidian  and  Carroll  (1986),  using  Theorem  1  we 


have  that 


N’1/2(V  -  6)  =  (1/2)  N'1/2  2^  {log  q2  -  E (  log  q2)}  (v.  -  v)  -  0  (1)  ; 
Li,  1  =  11  11  p 

1/2  - 1 / 2  X  2  2  — 

X  <®MML  "  6)  =  (1/2)  N  Zi  =  l  {Qi  '  E(qi)}  <Vi  *  V)  *  %(1)  : 

X’1  2 (® pL  ~  •)  =  d/2)  N_1/2  M"1  (e.2  -  1)  U.  -  v)  -  %(1)  , 

so  that  by  Lemmas  A.l  -  A. 3  and  equation  (A. 5).  we  have 


v1/2(vpl)  '  V/0 


-1/2  X  M  2 
=  (NM)  ri=1zj=1(t.. 


1){1  *  d0(v.  -  v)/oJ>  -  o(l) 


which  with  the  central  limit  theorem  gives  the  same  limit  distribution  as  in 
(36).  We  also  have  that 


s 

t!»JI 

>'Si 

$ 

•m 


•K’fjj 


-•S5j 

•’M 

$ 

t'V 


*CS«5 


1/2  *  *  -1/2  \  M  2 

V  (!7C(LL)  -  nc),o  =  (N’M)  r.=lzj  =  lu..  -1) 

-  d  M1/2X~1/2ZN  (v.  -  7) log  q2/o2  -  a  (1) 

0  1=1  l  &  Mi  v  p 


1'2~  *  -  1  '  2  \  M  2 

AqN  '  d7c(MML)  -i7c)/o  -  (NM) 

,  1/2  -1/2  X  .  -.2,2 

'  d0M  N  2i  =  !(Vi  “  V)V°v  *  V!)- 


Simple  central  limit  theorem  calculations  yield  the  same  limit  distribution  as 
in  (3.4)  and  (3.3).  0 


Kemark :  Result  (3.3)  is  based  on  a  obtained  from  the  residuals  of  the  final 
fit  of  the  mean  response  function  as  for  the  log-line  arized  method  and 
pseudo- 1 Lke 1 ihood ,  so  that  Lemma  A. 3  holds.  The  modified  maximum  likelihood 
method  also  provides  a  joint  estimate  of  a  along  with  the  estimate  of  6 .  If 
one  considers  this  estimator  in  place  of  o  in  Lemma  A. 3.  it  can  be  shown  that 
the  resulting  estimator  of  minimal  detectable  concentration  has  even  larger 
asymptotic  variance  than  that  in  (3.5).  For  reasons  of  space  we  do  not  prove 
this,  but  it  certainly  has  interesting  implications  for  practice. 


Proof  of  Theorem  2  :  By  (A. 5).  for  any  of  the  estimators  x^ ,  since  q  =  f  (x,/3] 
we  have  the  limit  result  that  for  some  A, 


1/2  *  *  y 

N  {  #  (xc  ,/3 )  -  e  (xc./J)  }/o  S  N(0.4). 


Thus,  for  i  between  x  and  x  ,  defining 
c  c  c 


1/2  *  *  * 

W  =  N  (  (x  ,/3)  (x  -  x  )  /  o ,  we  have 
A  X  c  c  c 


ffiW  I 
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WN  '  fxUc'/3)  "  N(0.^).  . 

where  (  iv.fi)  is  the  derivative  of  the  first  component  of  P.(v.fi).  It  thus 
suffices  through  (A. 4)  to  prove  that 

*  P 

p  (yc.fi)  /  (( xc>/5 )  — ►  l. 

*  * 

But  this  follows  from  (A. 6)  since  q  /a  =  P ( x  ,fi)/a  -*  a  ,  see  Lemma  A.l.  The 

c  c  c 

result  now  follows  from  Propostion  1.  O 

Proof  of  Lemma  A. 2:  By  a  series  of  Taylor  expansions  and  using  Lemma  A.l. 


(A. 7)  N1/2{h(/7c>/3)  -  h(0./3)}2/a2 

=  \'1/2{h iq.fi)  -  h(0./» )}2/o2  -  c  (N"1/2) 

c  p 


1  '2  *  2  2 

=  N  {h(i7c>/})  -  h(0 ,fi))c/a* 

*  *  1/2  '*?  -1/9 

-  2{b(q  fi)  -  h(0,/3)  >  {d/dq  h{q /}))N iq  -q  )/a -O  (N  ) 
c  c  c  c  p 

1/2  *  22 

=  N"  {h(nc.fi)  -  h ( 0 ,/3 ) )  foc 

*  2  1/2  '  *2 
- 2TJc{d/dq  biO  ,fi))cXu  ‘  iq  q  ~nc)/°  +  o  (l) 


1  /2  *  2  2 
=  N’1'  *  [h{q  c,fi)  -  h(0  ,fi)r/c 

2  1/2  ~  * 

-  2a  {3 /dq  h(  0  ./3)  iq  -  q  )/a  -  o  (1). 

v  v  C  P 


Similar  calculations  taking  into  account  that 


1/2  ~ 

N  'ifi  -  fi)  =  O  (o) 


* 

and  q 

c 


yield 


0 


I"  *  -  X  «  *_•  »  •  «  *  <  1  .  <  . 
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(A. 8) 


,1/2 


2Q  ~  ~o  2 

h  ( nc-P)a  /(3to  ) 

1/220  *  20  *  1/2  "2  2 
N  JT  (/7c  ,p ) /M  *  h  07  .PHN  /M)(o  -  a 

20  *  *  1/0“ 

*  ( 2/M)h  (/7c>/5)  Uog  hd7c./J)}  N  (6  -  6) 

-  (20  /M)h2*"!(i7*.p)h  (I?*,/*)  N’1/2(/3  -/J)  - 


)  /o 


2 


%(1, 


=  (h 


prt  ♦  1  'O  pfl  -i  /  p  **  p 

(/7c,/3)/M}\-J/  -  (c/M)  ii  ( 0  ,/3 )  N'1  ;o  -o)  o“ 

(2c/M)  h2w(0,/J)  {log  h(0,/3) }  X1/2(0  -  0)  -  0  (1). 


Combining  (1.6).  (3.2),  (A. 7)  and  (A. 8)  yields  (A. 5).  □ 


Proof  of  Lemma  A. 3:  Define 


o2  =  -  f(x.,/J)}/f9(x.,/8)]2  =  (NMfVz^Z^e^ 


Then,  since  (NM)12(/5  -  fi)  =C  (1), 


1  /  p  A  p  Ap  p  — 1/PV  V  A  p  OQ  * 

(SM)*'-(o“  -  o‘)/<3  =  (NM)'  Z^  =  ;)Z‘]=1[{Y  -  f  (x.  ,/})  }“/f  (x.,/3) 

J  ij 

p  on  _p 

-{Y.j  -  f(xI./J)}Vf"(x1./J)2o 


(A. 7) 


-1  /2  X  M  2  20 

'  ViaslZ^l[{Yij  -  flx.^Jpf  (x.,/3) 

~{Y1  j  -f(x.  ,p)}2/f2S(x.  ,/0)]a-2  -  ep(l) 


-2v(NM) 1  2(0  -  «)  -  o(l). 


completing  the  proof.  □ 


W0bi*.Us'  vM* 

i  «r» 


/V; 
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Table  fj 

Three  Estimates  of  the  Variance  Parameter  9 


Monte-Carlo  Bias 


M  =  2 

M  =  4 

Log-linearized 

0. 15 

0.001 

Pseudo-1 ikel ihood 

f  =  1 

0.045 

0.022 

't  =  2 

0.000 

0.001 

€  -  3 

0.004 

0.000 

Variance  Relative  to  Pseudo- 1  ike  1 ihood  with  t  =  2 
M  =  2  M  =  4 

Monte-Carlo  Asymptotic  Monte-Carlo  Asymptotic 

Log-linearized  2.85  4.93  1.71  1.87 

Pseudo- 1 ikel ihood 


Table  »2 


100  x  Mean  Minimum  Detectable  Concentrations 
M  =  2  M  =  4 

*  Replicates  Replicates 

9  Known  6  Estimated  9  Known  9  Estimated 

Unweighted  Least  13.106  13.106  9.173  9.173 

Squares 

Log-Linearized  3.937  4.346  2.718  2.785 

Pseudo- 1  ike  1 ihood 

«  =  1  -  4.216  -  2.809 

x  =  2  3.927  3.934  2.715  2.722 


I 


Table  »3 

Ratio  of  Monte-Carlo  Variance  of  the  Estimate  of 
Minimum  Detectable  Concentration  Relative  to  Pseudo-likelihood 

with  t  =  2  Cycles 


M  =  2  Replicates 
fl  Known  0  Estimated 


M  =  4  Replicates 
0  Known  0  Estimated 


■p.we  ighted 
.east  Squares 


14.90 


8.46 


18.83 


13.72 


Log- ! inearized 


1.02 


2.72 


1.00 


1.41 


Pseudo- 1 ikel ihood 
<  =  1 


1 .  19 


1 .  10 


.-l 


Table  »4 


Data  for  Example  of  Section  5 


Concentration  (x) 

Response  (Y) 

0 . 000 

1.700, 

1.660, 

1 . 950 . 

2  . 

070 

0.075 

1.910. 

2.270, 

2.110. 

2  . 

390 

0. 1025 

2.220. 

2.250, 

3.260, 

2  . 

920 

0.  135 

2 . 800, 

2.940, 

2 . 380, 

2  . 

700 

0.185 

2.780, 

2.640. 

2.710, 

2  . 

850 

0 . 250 

3.540, 

2.860, 

3.150, 

3. 

320 

0 . 400 

3.910, 

3.830, 

4.880. 

4  . 

210 

0.530 

4.540, 

4.470. 

4.790, 

5 . 

680 

0.750 

6.060, 

5.070, 

5.000. 

5 . 

980 

1 .000 

5.840. 

5.790. 

6.100, 

7  . 

810 

1 .375 

7.310, 

7.080. 

7.060, 

6. 

870 

1 . 850 

9.880, 

10.120, 

9.220, 

,  9 

.960 

2.500 

11.040, 

10.460 

,  10.880, 

11.650 

3 . 250 

13.510, 

15.470 

,  14.210, 

13.920 

4.500 

16.070, 

14.670 

.  14.780. 

15.210 

6.000 

17.340, 

16.850 

.  16.740, 

16.870 

8.250 

18.980, 

19.850 

.  18.750, 

18.510 

11.250 

21 .666, 

21 .218 

.  19.790, 

22.669 

15.000 

23.206, 

22 . 239 

,  22.436, 

22 . 597 

20  250 

23.922, 

24.871 

,  23.815, 

24 .871 

27.500 

25.748, 

25.874 

,  24.907, 

24 .871 

37.000 

24.441  , 

25  87  4 

.  25.748, 

27 . 270 

50.000 


29.580,  26.698.  26.536.  27.18 


V 

■v 


Table  *5 


Estimates  of  8  .  a  and  x^  based  on  example  of  Section  5 


Leas 

* 

Pseudo- 

Log 

Mod  if ied 

Squa 

res 

likel ihooc 

f =2 

Linearized 

Max . 

Likel ihood 

X 

X 

e 

X 

9 

X 

9 

C 

c 

c 

c 

Full 

1554 

.0790 

4750 

.0793 

.4757 

.0822 

.4500 

Dupli¬ 

cates 

t 

1  &  2 

2230 

.0728 

7000 

.  0476 

.9404 

.0659 

.7500 

2  &  3 

2385 

.  1555 

3500 

.  1870 

.  1950 

.  1739 

.2500 

3  &  4 

2513 

.1324 

5750 

.1112 

.6940 

.1104 

.7000 

1  &  4 

1593 

.0612 

5500 

.0601 

.5931 

.0695 

.5000 

:  &  3 

1859 

.0938 

4500 

.0981 

.4233 

.  0909 

.  4750 

Mean 

2116 

.  1031 

5250 

.  1008 

.5692 

.  1021 

.  5350 

SD 

0763 

.0357 

1183 

.0491 

.  2511 

.0439 

.  1997 

N'ote:  Means  and  SDs  are  based  only  on  the  five  reduced  permutations  of  the 

data  with  duplicates. 
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